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SUMMARY 

An  iterative  procedure  for  obtaining  the  characteristic 
root  of  largest  absolute  value  of  a  positive  matrix,  the 
Perron  Root,  is  derived  which  yields  geometric  conver¬ 
gence. 
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CN  AN  ITERATIVE  PROCEDURE  FOH  OBTAINING  THE  PERRON  ROOT 

OF  A  POSITIVE  MATRIX 


Richard  Bellman 


jl.  Introduction 


The  purpose  of  this  paper  is  to  present  a  new  Iterative 
procedure  for  obtaining  the  characteristic  root  of  largest  abso¬ 
lute  value  of  a  positive  matrix. 


The  origin  of  the  method  is  as  follows.  There  is  a  result 
of  Von  Neumann,  [7],  a  generalization  of  hi:  fundamental  mln-max 
theorem  in  the  theory  of  games,  [8],  to  the  effect  that 

(1)  Min  Max  ( x,Ay )  m  Max  Min  (x ,Ay ) 
y  x  (x.fiyj  x  y  ( x , By ; 


where  the  variation  is  over  the  region  defined  by 


(2) 


R 


(a) 


X1  A 


1  , 


n 

M  y,  >  o»  21  y«  -  1  * 

l-i  1 


and  it  is  assumed  that  B  has  the  property  that  (x,By)  ^  b  >  0  for 
all  ( x  ,y )  €  R* 

It  was  observed  by  Shapl^y,  [6]  ,  that  this  result  can  be  ob¬ 
tained  as  a  by-product  of  the  theory  of  "games  of  survival",  cf  , 
[5]  ,  [6],  which  requires  only  the  fundamental  min-max  theorem,  by 
considering  the  equation  for  A , 
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{})  ^  -  Min  y ax  [  (x.Ay)  ♦  A  U-(x,By) )  J  , 

y  x 

■  Max  Min  [  (x,Ay)  +  A ( l-{ x ,By ) )  ]  , 
x  y 

where  we  Impose  the  additional  assumption  the  1  >  (x,3y)  for  all 
(x.y)  €R.  "hi?  restriction  is  of  no  importance  because  of  the 
homogeneity  of  the  ratio  in  (1). 

It  is  then  easy  to  prove  that  there  is  a  unique  solution  of 
O)  which  may  be  obtained  as  the  limit  of  the  sequence  defined 

by 

(4)  A0  -  Min  MdX  [  (x.Ay)  ]  -  Max  Min  [  (x,Ay)  ], 
y  x  x  y 

^n+l  *  Mln  Max  C  (x.Ay)  ♦  \n  (l-(x.By))  ], 

y  x 

-  Max  Min  [  (x.Ay)  ♦  An  (l-(x,By))  ], 
x  y 

and  that  this  solution  is  the  given  also  by  the  common  value  of 
the  ratio  in  (l). 

This  procedure  yields  a  theoretical  and  computational  hold 
on  ,  which  1.  quite  useful.  furthermore ,  by  means  of  this 
Ingenious  device  we  havp  3  means  of  linearizing  a  number  of  pro¬ 
blem.  relating  to  ratios.  in  this  paper  we  shall  apply  this  idea 
to  the  problem  of  determining  the  root  of  a  positive  matrix  of 
largest  absolute  value,  using  a  variational  representation  for 
this  root  involving  a  ratio. 
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52.  The  Perron  Root 

Let  A  be  a  square  matrix  (a^j).  It  is  called  positive*- If 
a 1 j  >  0  for  all  1  and  J.  The  basic  result  concerning  positive 
matrices  Is  due  to  Perron  and  Is  the  following. 

Lemma  1.  If  A  Is  a  positive  matrix,  there  Is  a_  unique  characteristic 
root  of  largest  absolute  value.  This  root  Is  positive  and  Its 

associated  characteristic  vector  may  be  taken  to  be  positive. 

Notation.  We  denote  this  root  by  p(A),  the  Perron  root  of  A. 

An  alternative  definition  of  this  root,  possessing  the  great 
merit  of  Involving  a  variation.  Is 

Lemma  2. 

n 

(1)  p(A)  •  Max  Min  aijxj/xi 

x  1  J-l 

-  £  aijxjAi 

x  1  J-l 

This  result  has  been  used  by  several  authors  independently, 
and  does  not  seem  to  have  any  particular  known  origin.  It  was 
communicated  to  the  author  several  years  ago  by  H.  bohnenblust 
In  connection  with  a  different  problem,  see  [2]  . 

Here  the  variation  is  over  the  region  defined  by 

(2)  xA  £  0,  £  Xj  -  1. 

*  not  to  be  confused  with  positive  definite 


P-577 


3  3 .  A  Refinement  of  Lemma  2 


Let  us  show  tnat  Lemma  2  may  be  replaced  by  the  stronger  result 


Lemma  3 •  We  have 


n 


(1)  p (A )  -  Max  Min  a1^Xj/x1 

R'  1  J=1 

n 

=  Min  Max  5"  a-.x./x. 
D  I  A  ^  J  J  ^ 

H  1  J-l 


where  R*  ljs  defined  by 


(2)  ^  d,  ^  Xj_  -  1  , 


and  d  1_3  some  parameter  depending  only  upon  A.  Specifically,  we 
may  take 

n 

(3)  d  - 


Min  a.  ./faax  (  5”  aii  )• 
1,J  j-i 


Proof:  The  minimizing  x^  constitute  the  characteristic  vector 
associated  with  p(A),  normalized  by  the  condition  that  Z  x«  •  1« 

a  ^ 


.ience 


n 


(4)  p(A)x.  *  5"  a..x,  ,  1  -  1,  2,  ...»  n. 


1  1JJ 

J-l 


Thus 


(5)  p(A)  Min  x 
1 


i  >  (;l: "  au)  Z  xj  -  f"  au 

*■  9  J  J®1  ***  •  J 
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Cn  the  other  hand, 

n 

(6)  p ( A )  Max  x.  <  Max  x.  (Max  S~  a,.) 

i  i  i  r-; 

J*1 

whence 


(7)  p(A )  <  Max  (  a.  .). 

“  i  J-l 

Combining  (5)  and  (7)  we  have 


(8)  Min  x 
1 


i  i'?1"  au>- 

1,J  J-l 


§b.  An  Alternative  Definition  of  p(A' 


Let  us  now  show,  following  the  lead  of  Shapley,  that  we  may 
define  p(A)  as  follows 

Lemma  *♦.  p(A)  ls_  the  unique  solution  of 

n 

(1)  Max  Min  [  a^x^  ♦  AU-Xj)  ] 

R’  1  J-l 

or  of 

n 

(2)  Min  Max  [  £  aijx<j  ♦  AU-x^  ]  , 

R‘  1  J-l 

where  P'  Is  as  defined  by  (3.2). 


Proof:  It  is  sufficient  to  prove  that  p(A)  satisfies  (1).  The 

proof  of  the  other  statement  Is  similar.  We  have,  for  all  x  in 
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n 

(5)  A  >  «in  [  aijxj  +  ^(l-Xj)  ]  , 

1  J-l 

for  any  solution  A,with  equality  for  at  least  one  x.  We  shall 
prove  below  that  there  is  exactly  one  solution  which  may  be  obtained 
iteratively. 

Hence,  for  all  x€P', 
n 

(  -’0  0  >  Min  [  JT  a1JxJ  -  Ax13  , 

1  J-l 

or 

(  =  )  C  >  Min  [  -f^T  a^x^/xj-  3  » 

1  lJ«l 

for  all  x  €  R 1 .  Since  Xj^  >  0,  it  follows  that 

n 

(6)  A  >  wln  aijxj'/xi^ 

1  J-l 

for  all  x,  with  equality  for  one  x,  at  least.  Hence 

n 

(7)  -ar  Min  (21  aijxj//xi^  ■  p(A)* 

R'  1  J-l 

which  shows  uniqueness  provided  we  assume  existence. 

Similarly  we  may  demonstrate  the  result  in  (2) 

55.  A  Non— Linear  Recurrence  Relation 


Let  us  now  consider  the  non— linear  recurrence  relation 
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(1>  un+i 


n 


"I  T  t  Z  ’uxj  -  ^  . 

j«l 


wher«  R'  i3  as  above  and  ur  i  s  arbitrary.  We  shall  prove 


Theorem 


(2)  p ( A )  -  lim  u 


n->oo 


n 


A  similar  result  holds  for  the  recurrence  relation  based  upon 


(4.2) 


Proof:  We  have 

(3)  un+l  *  »*?  C  J  atJx  +  un(l-Xl)  J 

J-l 

’  C  j>  yl  C  Z  aljXj  ♦  un(l-Xl)  ]  ]  , 

7  1-1  J-l 

n 

where  the  maximum  in  y  is  over  the  region  >  0,  y^  ■  1. 

1-1 

Using  the  mln-max  theorem  of  Von  Neumann,  this  may  also  be  written 

(4)  un+1  .  Max  Min  [f  aux  +  un(l-Xl)  ]}  . 

y  *  m-i  >i  J 

Let  us  write  this  recurrence  relation  in  the  form 

(5)  un+i  "  Mln  Max  T(u  ,x,y)  -  Max  Min  T(u  ,  x,y) 

R '  y  y  R «  n 

Then  using  a  device  we  have  employed  frequently  in  the  theory  of 
dynamic  programming,  cf  [2j  ,  p]  ,  we  have 
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'  (6)  un+1  -  T(un,x,y)  , 

un  ‘  T<un_j,x,y)  ,  ' 

I 

where  (x#y)  and  (x,y)  are  respectively  values  where  the  mln-fliax 

l 

and  max-nin  are  assumed  for  n  and  n— 1  respectively. 


Hence,  by  virtu®  of  (5) 


(7)  un+i  "  7(un,“,y)  >  T(un,x,y) 


<  T(un,x,y)  , 


and 


(c)  un  =  _  T(un_i*x,y) 

From  this  we  obtain 

(9)  un+l“un  ^  T(un»?»y)  “  T(un_i^y) 

<T(un,x,y)  -T(un-1,x,y)  , 

which  yield: 


n  — 


(i0)  un+l-°n  i  Z 

i-1 


<  K^n-l1 


n 


y±  ( ) 


1-1 


Hence 
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(11)  •un+l-unl  1  IW-ll  M8X  t'2.  ^  yi(1-xi>  3  • 

i-1  i-1 

Since  x1 ,  x^  d  >  0,  and  >  0,  2T  -  1,  w*  have 

<12>  lun^nl  1  (1^}  i^n-ll  ' 

00 

and  hence  geometric  convergence  of  5*  (u  , -u  ).  The  limit  of 

I MO  11+1  " 

un  exists,  and  must  equal  p(A).  Observe  that  this  is  a  situation 
where  only  the  value  of  a  game  13  of  interest,  if  we  wish  only  to 
determine  p(A).  Consequently,  the  iterative  procedure  of  [4], 
may  be  of  some  merit  here. 

$ 6.  Monotone  Convergence 
If  we  set 

(1)  un  ■»  Min  Max  a.  .x  , 

*  J 

we  see  that  u^  >  and  hence  which  ensure:  monotone 

convergence . 

Similarly,  if  we  have 

(2)  ax  <  3lJ  <  a2, 

and  use  the  Perron  roots  of  the  associated  matrices  as  Initial 
approximations,  w<°  obtain  monotone  increa.  inr  and  monotone  decreasing 
sequence:  respectively. 
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